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TECHNICAL MEMORANDUM X- 73348 


NEAREST NEIGHBOR. BILINEAR INTERPOLATION 
AND BICUBIC INTERPOLATION GEOGRAPHIC 
CORRECTION EFFECTS ON LANDSAT IMAGERY 

I. INTRODUCTION 


Tiiere are basically two steps involved in geographically correcting 
image data. The first step is iitiUzation of a transfox'ination, which tells where 
to obtain grey scale information from the original data for a particular pixel 
location on a geograpiiically correct coordinate system image. In a majoi’ity 
of cases, the location for obtaining grey scale information from the original 
image occurs in between pixels, and this requires that the grey scale value be 
estimated. The second step, therefore, involves deciding how to assign or 
estimate the grey scale value. There are three techniques commonly used for 
determining the proper grey scale value: Nearest Neighbor (NN) , Bilinear 
Interpolation (BL) , and Bicubic Interpolation (BC). Figure 1 illustrates how 
the grey scale values arc determined for a location (X) in between pixels 
(represented by a dot) for the three teclmiqucs. For NN there is a direct 
assig-nment (indicated by an arrow) of a grey scale value of tlie pixel that is 
closest to the location X. For the interpolation techniques, tiic lines connecting 
pixels show the pixels used in intex'polating to determine a grey scale value at 
the location represented by deltas. The lines connecting the deltas show another 
interpolation process required to determine the grey scale value at the desired 
location X. The BL requires a pair of pixel grey scale values, while the BC 
requires a set of four pixel grey scale values. 

The objectives of the effort are to determine what effects are observed 
when image data are geographically corrected using tlie three teclmiques and 
to be aware of potential impacts these effects may have on image compression 
and classification. Effects imply that there will bo a de\iation between what 
is observed and what is expected or at least a change will be noticed as a i-esult 
of the registration (geograpMc correction) process, hi this case, there are 
only tlirec basic questions that can be asked; wiiat has changed, how much 
change is there, and where do these changes occur? 
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Fisiiro 1- Grey sc-alc determination for NN, BL, 
and BC at location X. 


II. BRIEF DESCRI PTION OF THE IMAGE DATA 


The data set consisted of Landsat digital imagery, April 4, 1973, ID 
Number 1265-15444. The test site extracted from that imagery was 255 pixels 
wide and 200 scans long, and corresponded to the Bald Kriob, Tennessee 
Quadrangle. The data ware geogTapIiically corrected to correspond to a digital 
ground truth map (GTM) , aupplied by the Tennessee State Planning Ol’lice 
(TSPO) of Nashville, Tennessee, that was 565 pixels wide and 500 scans long. 
This particular data set has been extensively described, literally and picto- 
rially. as well as extensively classified with various classification tcclmiques 
that are discussed in a NASA Report. ^ According to the ground truth informa- 
tion, the test site is 0. 83 percent urban, 2. 53 percent transportation/ 
communication, 28. 68 percent agricultiTre, 65. 93 pei'cent forest, and 2. 03 
percent water’. 


1. Jayroe, R. , AtldTTSon, R. , Dasaratbv, B. , Lybanon, M. , Ramapriyan, IT. 
Classification Software Technique Assessment. NASA Teclinical Note, NASA 
TN D-8240, May 1976, 
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111. RESULTS 


To determine what had clianged and how much change was obseiwed, 
histograms were computed for the original four bandf. of data and for the four 
bands of data that were geographically corrected using NN, BL, and BC. The 
liistograms of original image had to be normalized so that all of the histo- 
grams contain the same number of pixels, because the original image was 
approximately four times smaller than the gcogr-apMcally correct image. 

Tables 1 tlirough 4 show tiiis infonnation for the four bands as well as histo- 
gram deviations between tlie original data and t!ie geographically corrected 
data. Maxima and minima of tlie histograms are indicated by X and N, respec- 
tively, and the mode of the liistoga'am is indicated by XX. The lines separating 
grey scale values show where each band was densitj' sliced to produce grey 
scale images. In the columns of deniations, a plus sign indicates that more 
pixels of a particular grey scale value were requested to be tvansforred from 
the original image to the corrected image tlian wore present in tiie original 
image. A minus sign indicates that not all of the pixels of a particular grey 
scale value were requested to be trajisferred from the original to the corrected 
image. 


One possible interpretation is that the number of pixels witli grey scale 
values that were left over on tlie original imago (indicated by a minus sign) 

Imd their grey scale values changed to accommodate a request for more pixels 
of another grey scale value (indicated by a plus sigii) . In this sense, the 
number of grey scale value changes that occurred is shown as absolute value 
sums under tlie deviation columns. Tliis number divided by two is tlie numbei* 
of pixels which had their grey scale values changed. The numbers under tlie 
four columns to the left of the deviation coUmms show that all of the liistograms 
for the test site contain 211 075 pixels. 

Examination of the maxima and minima of the liistograms shows that NN 
most nearly preserves the histogram atructux'c of the original data, wliile the 
interpolation methods act as a filter smoothing away most of the structure. 

This tends to malce the procedure of choosing density slices more difficult 
because all of the natural indications in the data are no longer there. Also, 
tlic least amount of grey scale changes occur for NN. Table 5 shows the 
statistics calculated from the histograms, and indicates that, althoxigh the 
mode of the histogram may change, the mean value appears to be changed 
very little. However, tlic variance is reduced quite considerably in some 
cases. Table 0 is a summary of the number of pixels tliat had their grey scale 
values changed and the resulting percent changes in the histograms. 
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TABLE 1. CHANNEL 1 mSTOGRA]\IS AND DEVIATIONS 
FOR TSPO DATA SET 
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TABLE 2. CHANNEL 2 HISTOGRAMS AND DEVIATIONS 
FOR TSPO DATA SET 
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TABLE 5. HISTOGRAM STATISTICS FOR TSPO DATA SET 
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TABLE 6. HISTOGRAM DEVIATION STATISTICS FOR TSPO DATA SET 
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Selected more pix^jls tlian were available from a particular grey, hence tlie pixels that were left over 
had to be relabeled. 



Figures 2 through 5 present black and white representations of color 
coded joint Mstograms between channels 2 and 3 for the original data and for the 
three geograplucally corrected sets of data. In the figures wliite represents no 
simultaneous occurrence of pixel values in channels 2 and 3 except for the pot.^: . 
tliat appears in all tiie figures near the bottom of the joint Iiistograms. hi this 
case, white shows w'here a majority of the data occur and these data belong 
mostly to the forest category. Again, NN preserves most of the structure of the 
original joint Iiistogram and the filtering or smoothing effect of the interpolation 
tecluiiques is visible in Figures 4 and 5. 

Figures 6 and 7 show the result of density slicing the original data and the 
BC corrected data, respectively, for cliannel 1 using the slices indicated in 
Table 1. In Figures G and 7, the lighter areas represent forest and the darker 
areas represent agriculture. The curvilinear feature at the left (west) center 
edge of the image is a portion of a river, which continues across the center of 
the image. The cuiwilinear feature starting at the middle of the bottom (south) 
edge of the image and continuing towards the top left corner is a liiglwvay. K 
Figure 6 is viewed from an cast-west direction, the linear pattern of banding 
is evident. However, if Figure 7 is viewed from an east-west direction tlie 
banding is considerably less evident. BL and BC tend to reduce the banding 
problem, whereas NN does not. 

To determine where the deviations occur, absolute value difference 
Iiistograms and in.nges were computed for the tliree geographic correction 
techniques. The images obtained from using NN, BL, and BC can only be 
compared with tliem selves and not with the original image, wMch has a differ- 
ent coordinate system. The first column in Table 7 is the absolute value grey 
scale differences that can occur when the gcograp Ideally corrected images are 
absolute value differenced. The next four columns are the nmnber of pixels in 
each, channel that have a particular aljsolutc value grey scale difference for 
comparing NN and BL, The remaining eight colvumis are interpreted in a 
similar manner. Table 8 shows the accumulative percentages for the absolute 
\ialue differences. For example, when NN is being compared ivith BL using 
cliivnnel 1, 55. 02 percent of both images are identical, 89, 3 percent differ by 
±1 or less, and 9G, 28 percent of both images differ by ±2 or less. Figure 8 
shows an absolute value image difference of BL and BC for channel 3. The 
areas where the is no disagreement occur where there is no sjnnbol, and the 
larger and darker symbols indicate larger absolute value diffei’ences. The 
largest differences appear to occur at transitions between features, such as 
agriculture and forest, because these features are rather cleaiTy outlined. 
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Figure 2. Joint liistograni of channels 2 and 3 for the original data. 




Joint histogram of channels 2 and 





Figure 5. Joint histogram of channels 2 and 3 for BC corrected data. 





Density slice image of channel 1 for the original data. 







risiirc 7. Densitj' slice image of channel 1 
for the BC corrected data. 
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TABLE 7. ABSOLUTE VALUE DIFFERENCE HISTOGRAM FOR NN, BL, AND BC OVERXAYS 
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TABLE 8. ACCUMULATP/E PERCENTAGES FOR ABSOLUTE VALUE DIFFERENCES 

OF ISfN, BL, AND BC OVERLAYS 
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Fif^urc 8. Absolute value image diffei'ence of BT and BC for chann.'l 3. 


A linear pattern of agreements and disagreements can be seen in the direction 
from the lower left corner to the upper right comer of Figure 8. The light 
linear patterns correspond to data taken from locations very close to pixels 
on the original image, and the dark linear patterns correspond to data taken 
from locaWons in between pixels on the original image. This linear pattern 
occurs in all the image differences mth each pair of geographic correction 
techniques and, therefore, must be present to some degree in all of the geo- 
graphically corrected data. 


IV. SUMMARY OF OBSERVATIONS 


Based upon the results obtained from comparing the original image data 
and the geographically corrected image data and fr'om comparing the corrected 
data using NN, BL, and BC, the following observations were made; 

a) The histograms provided information on whetlier or not the same 
number of pixels were selected from each grey scale category and transferred 
from the original to the geographically correct image. The histograms provide 
no information on where the pixel grey scale values are placed in the geo- 
graphically correct image. 

b) The absolute value Image differences provide information on where 
the disagreement occurs between the correction techniques and on the consist- 
ency of the teclmiques, but do not indicate which teclmlque is best. 

c) In all channels, the NN histogram is most like the original data 
histogram in that it preseiives the maxima/ minima structure of the original 
histogram and does not create any new grey scale values. 

d) Tlie interpolation metliods act as a filter smootliing out most of the 
original histogram maxima/ minima structure and may create new great scale 
values tliat were not present in die original liistogram data. 

e) The following is a ranldng for chamiels 1, 2, and 3 according to 
histogram similarities; 

1) NN is most like O 

2) BC is most like BL 
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3) BC is most like NN 

4) BC is most like O 

5 ) BL is most like NN 
G) BL is most like O. 

Tliere was very little difference observed between categories 4) and 5) in 
channels 1 and 2, but were smtched in channel 3. 

f) The ranldng for channel 4 was: 

1 ) NN is most like O 

2 ) BC is most like NN 

3 ) BC is most like O 

4 ) BL is most like O 

5 ) BL is most like NN 
G) BC is most like BL. 

Comparing with the original liistogram only, NN, BC, and BL, respectively, 
were most like O for all channels. 

g) Hie correction teclmiques appear to have little effect on the image 
mean value, although the mode may change, but the variance of 'die image was 
reduced. In all channels, BC reduced the variance the least, then NN and BL, 
respectively. 

h) Very little difference could be seen between the original and the 
geograpliically corrected images when density slicing was used. However, the 
interpolation methods appeared to partially remove some of the banding. 

i) Comparisons of the geographically corrected images indicate that 

30 to 65 percent of tlie pixels were in exact agreement, and that 65 to 9? pc ccent 
of the pixels differed by ±1 oi' less. 
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j) In comparing the registration metliods, the most agreements occurred 
in channel 1, then 4, 2 and 

k) The greatest disagTeements appeared it transitions between two or 
more features, and the majority oi disagreements t ppeared evenly spread over 
tlie image difference. The greatest disagreements appeared to show up more 
readily in tlie infrared chaimels than in the visible channels. 

l) A regular linear pattern of agi'eement and disagreement appears in 
all of the geograpliically corrected image differences, which is a direct result of 
the geographic transformation. 

n) The CPU time for the NN, BL, and BC was 34, 8, 59.6, and 135. 5 s, 
respectively. 

As a result of these observations, there ai’e some potential problems 
tliat are worth exploration and commentary. First, if the image contained a few 
large homogeneous areas, then it proi.ably would not matter wliich geographic 
correction teclmique was used to correct the image, at least in the large homo- 
geneous areas. The problem areas are the transitions between two or more 
features. The results presented in the reference (footnote) also show that the 
majority of misclassifications occur at transitions between two or more features. 
Thus, tliere is a question of whether the image data should be registered (geo- 
graphically corrected) and then classified or classified and then registered. 

If the image data are classified first, then the choice of registration teclmiques 
is limited i ' he NN. Tliis procedure needs to be explored to determine the 
order and combination of registration and classification techniques that mini- 
mize classification errors. 

Secondly, preliminary results using transform compression teclmiques 
indicate tliat the greatest deviations between the compressed/ reconstructed 
image and tlie original image also occur at transition regions. Hence, tlae 
order of importance of compression and registration need to be explored as 
well as their combined impact on various classification teclmiques. 

Thirdly, die transform compression teclmiques and the interpolation 
geographic correction methods act as filters on the image data, smoottiing out 
most of tlie natural discrimination present in the original image data. These 
two effects, plus the fact that the transformation injects linear patterns into the 
image data, need to be explored for impact on change detection and multitemporal 
classification. 
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